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ABSTRACT ^ 

Research examined the hypothesis that predictive 
validity would be greater for a test given under stress instructions 
than for a test given under relax instructions • Ss were 25U education 
students in a graduate measurement course and 117 education students 
in an undergraduate measurement course. Ss were randomly assigned to 
the instructional conditions. For the graduate and xindergraduate data 
separately, a Pearson r was computed between pretest and final exam 
scores for each treatment group. On both graduate and undergraduate 
levels, the difference between the r«s was significant (p .)=) in the 
predicted direction, suggesting the usefulness of a stress dimension 
for enhancing predictability. (Author) 
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Problen 



For a number of years, psychological research has been pointinr up 
the need for viewing leamin;? and performance not only as a function of 
the material b ut also as ^ function of how different ihdivi"d{i?ili"F^:i ^nd tb ~ 



the material. As an implication of this viexj within the context of an 
academic test setting, test performance nav he hold to be a product not 
only of cognitive factors but also of personality factors operating 
within the individual. 

Considerin»» stress as an i-noortant cop>pon«;n.t of the total reaction 
of an individual, to a test situation, it is conceivable that the 
effectiveness of a test device as a predictor of subsequent performance 
could be enhanced by taking the stress factor into account. Accordingly, 
the research examined the feasibility of manipulating level of stress 
as a means of increasing the predictive validity of a test device. It 
was expected that the correlation between pretest and final exam per- 
formance for the Ss receiving the pretest under stress-inducinp (Stress) 
instructions would be higher than the correlation for the Ss receiving 
the pretest under non-stress-inducinp (Relax) instructions. This expectation 
was predicated on the assumption that the enfagenent of stress responses 



IThe investigators wish to acknowledge the assistance of nr.Tom Freijo, Dr. 
Uay Urbanek, Dr. Pvichard Jaeger, Dr. Rick Nations, Dr. Jack Robinson, f. Dr! 
Ed Boddy in allowing use of $heir students and helping gather the data. 



In the two test situations for the Stress group, being deliberately 
aroused in the pretest situation and a natural compcnant of the final 
exam situation, would enhance the consistency of the tvo performances, ' 
resultias in higher correlation. 
Procedure 

The Ss for the study were 254 education students enrolled in 13 
sections of a graduate Foundations c5 Keasurenent course and 117 upper 
level education students enrolled in 7 sections of an undergraduate 
Introduction to Keasurenent course at the University of South Florida 

-tfOTing Ihe 1971-72 acade:Hic year. Ail grad"^e~^;;;;;i;i;;;;^r;;;;^ " 

taking measurement as a requirement; the undergraduate nearureisent course 
was an elective course. 

The data were collected at the beginning of each of two acadenic 
quarters during 1971-72 academic year. The procedure vas identical for 
both quarters. During the initial class neeting of each class section, 
all Ss were administered a' 31-itein computational test presented as a 
pretest. The test, developed by the investigators, was similar to the 
numerical ability subtest of the Differential Aptitude Test. A pre- 
Itoinary form yielded a KR-2C reliability estimate of .93. In the study 
half the pretest booklets contained Stress instructions and half con- 
tained Relax instructions. Tlie differentially laotivating instructions 
Tvere patterned after those used by Nicholson (1953), I.G. Sarason & 
Palola (I960), & Hall (:969). The Stress instructions (Form S) pre- 
sented to the respondent a situation of lr„plied personal threat (e.g.. the 
test "is designed to provide information about skills that are believed 
to be needed for reasonable success in tnis course"). The Relax instructions 
(Fot» R) informed the respondent that interest in his performance was 
for experJmental purposes only, thereby allaying feeling of threat. 



As a basis for checklj^g ths. nature of the stress response aroused in 
the test situation, it vas assumed that the two instructional conditions 
vould register differently on a measure of state anxiety, Therefcre, the 
A-6tate scale of the State-Trait Anxiety Inventory, ?ora X (Spie3barger, 
Gersuch, and Lushene, 1968) was placed at the end cf the pretest to 
assess now the 1 felt while vorking on ths task. As a measure of how the 
S feels at a particu3^r^poi^ ±ti tiTOe. the A-^state scale operatior.alizes 
Spielberger's concept of state anxiety, i,s,, anxiety as a transitory 
state. 

After being introduced as a short "prccies solving task" vhose 
purpose vould "become clear as we proceed," the two foms of the pretest 
package were randor.ly distributed to the students in each class by the 
instructor of that class. The students were then directed to read the 
instructions to themselves. Throughout the test session, the students 
indicated no awareness that they were working under different sets of 
instructions. Approximately half of the students (Group R) in each 
class took Form R of the pretest package and the remaining half of the 
students (Group S) took Form S. At the end of the terra, each partici- 
pating instructor adainistered a final examination in the area of "tests 
and measurements". To account for the lack of unifonaity aaiong instruc- 
tors* examinations, each' final examination score vas converted into 
a standard score (non-normalized T) representing the individual's 
performance relative to the performance of his class section. 
Data Analysis & Findings 

Data on mean performance and variability of the^tetest and final 
examination across treatments arc presented separately for graduates and 
undergraduates in Tables 1 and 2, respectively, On the graduate level no 



significant differences were found between the means of the Stress and 
Relax groups on either the pretest or final examination, nor were 
significant differences found between the standard deviations of the tvo 
treatment groups (See Table 1). The analyses wore repeated for the under- 
graduate data with the saTne results (See Table 2). 

Insert 'Table 1 about here 



Insert Table 2 » about here 



To test the basic hypothesis on the graduate data a Pearson r; was 
computed between the pretest scores and final exam standard scores for 
each treatment group and a test for a significant difference between the ■ 
independent rs was carried out . The procedure was repeated on the under- 
graduate data. The results of these analyses are contained in Table 3. 
On the graduate data, the r obtained for Group S was .54 and the r obtained 
for Group R was .36. The difference between the r's was found by the 
appropriate z test (Wyatt & Bridges, 1966) to be significant (p<.05, one 
tail) in the predicted direction. On the undergraduate data, the r ob- 
tained for Group S was .37 and the r obtained for Group R was .07. The 
difference between these rs was also found to be significant (p<.05, one 
tail) in the predicted direction. All rs except the Relax r for under- 
graduates ir « .07) were significantly different from zero (p<.01). 



Insert Table 3 about here 



In an attes-.pt to exaiaina the nature of the stress responses 
elicited by the differentially motivating instructions, analyses were 
performed on the A-state data generated in the pretest situation. A-state 
means and standard deviations for the tvo instructional conditions are 
presented separately for graduates and undergraduates in Table A. No 
significant difference v;as found betveen the A-^state means of the Stress 
and Relax conditions on either the graduate data or undergraduate data. 



Insert Table 4 about here 



Conclusions & Discussion 

On both the graduate and undergraduate data, support was demon** 
strated for the hypothesis that the correlation for S^s under Stress 
instruction would be larger than that for Is under Relax instruction, 
indicating superior predictive power for the pretest adnsinistered under 
Stress conditions • The mc'aningfulness of these results is strengthened 
by the lack of significant differences in taean perfonaance and variability 
across treati:?ent groups on the pretest and posttest raeasures* Aside 
from the direct practical implications for the field of academic pre- 
diction, the results of the study buttress the view of test performance 
as a complex product of both cognitive and non-cognitive factors and 
encourages further study of specific non-cognitive factors as mediators 
of performance. 

The results of the study suggest the usefulness of a Stress dimension 
for enhancing the predictibility of performance. Even so, the precise 
nature of the stress response produced in the study remains in question. 
The investigators had assumed that the stress condition would operate as 



essentially an anxiety-inducing stiaulus, thereby invoking a higher 
level of transitory anxiety as laeasured fay the A-statc scale. That 
assumption earned no empirical support. 

The failure of the instructional conditions to register different 
levels of A-state may nean that differentially motivating instructions 
of the type used produce reactions of a type that cannot properly be 
'^°Hjjg£gli^^j^£gty_r enctions . On the other hand, the findings on 
A-state may be the result of an insensiti^Uy'of the A-state scale 
based on the nanner in which it was used. The investigators lean toward 
the latter as a possible explanation of the outcome. As noted under 
"Procedure," the A-state data were gathered at the conclusion of the 
pretest situation and the pretest itself functioned as a relatively 
easy achievement task (see Table 1). Any anxiety response that may 
have existed at the beginning of the pretest could have dissipated by 
•the conclusion of the task".. If such vere the case, the A-state results 
would reflect upon a design error witfhin the procedural process. These 
unresolved questions regarding the nature of the stress response 
produced in the study suggest the need for a ctore careful study of 
differentially motivating instructions as a mechanise of threat arousal. 



ref;rf.nces 

Hall, B. Anxiety, stress, task difficulty, and achiever^ont via 

progratned instruction. Paper read at AK^A Annual Conference, 

^Minneapolis, J'dnniesota, 1971. 
-Ticholson, The influence of anxiety upon learninj>: Interference 

or drive increment? Journal of Personality , 195f^, 26, 303- 

319. 

Sarason, I. G. , u Palola, 0. The relationship of test and general 
anxiety, difficulty of task, and experimental instructions of 
performance. Journal of Exoorimental Psychology , I960, 
59, 18 5-191. 

Speilberger, C. D., Gorsuch, L., & Lushene, R. E. The state- 
trait anxiety inventory, prelindnary test manual for form 
x. Tallahassee* Florida State University, 1968. (mimeo- 
graphed . ) 

Ityatt, W. W. , Bridges, C. Statistics for the b ehavioral 
sciences, Engelwood, Calif: Heath, 1967. 



Table 1 



Means & Standard Deviations of Pretest 
Scores & Final Exam Standard Scores under 
Stress & Relax Conditions for 
Graduates 



Pretest 



Final Exan 





SD 


M 


SD 


Stress 


25. Al 


5.69 


50.19 


9.71 


(N-130) 








Relax 


25.03 


6.00 


50.65 


9.67 


(N-124) 






/ 



ERiC 



Table 2 

Means & Standard Deviations of Pretest 

Scores & Final Exam Standard Scores under 

Stress 6 Relax Conditions for 
Undergraduates 



• 

Pretest 


Final Exon 




M 


SD 


M SD 


Stress 
(N.59) 


24.70 


5.31 


A9.03 10.12 


Relax 
(N-58) 


25.48 
\ 


4.81 


48.26 10.38 



Table 3 



Correlations of Pretest Scores with Final Exam Standard 

Scores under Stress & Relax Conditions for 
Graduates & Undergraduates 



Graduate 


Undergraduate 


Stress 


•5«* (N-=130) 


•37* (N*59) 




a 


a 


Relax 


•36* (N«124) 


.07 (N«=58) 






1 



*p<.Oi (two tail) 

"Difference between these two correlations significant (p<.05, one tail) 



'7 



Table 4 

A-state Means Standard Deviations under 

•Stress & Relax Conditions for Graduates 
k Undergraduates 



Graduate 




Undergraduate 


Stress (N=130) 


Relax (K=124) 


Stress (N=59) 


Relax (N=58) 


M 


41.34 


41.13 i 


39.22 


37.95 


SD 


11.46 
— 


11.81 


10.83 


10.52 



ERIC 



